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ASSESSING  THE  TAILORED  ADAPTIVE  PERSONALITY  ASSESSMENT  SYSTEM  FOR 
ARMY  SPECIAL  OPERATIONS  FORCES  PERSONNEL 

EXECUTIVE  SUMMARY 


Research  Requirement: 

The  Tailored  Adaptive  Personality  Assessment  System  (TAPAS)  was  developed  under  the 
Army’s  Small  Business  Innovation  Research  (SBIR)  grant  program.  It  takes  advantage  of  modem 
psychometric  methods  and  computing  technology  to  offer  a  new  generation  of  personality  measures 
that  meet  the  assessment  needs  of  diverse  occupations  and  military  occupational  specialties  (MOS). 
The  TAPAS  can  measure  up  to  26  personality  dimensions  (a.k.a.,  facets).  Of  those  facets,  21  cover 
the  behavioral  patterns  associated  with  the  well-known  Big  Five  personality  framework  (Goldberg, 
1993).  The  remaining  five  dimensions  cover  military-specific  personality  traits  (i.e.,  Physical 
Conditioning,  Courage,  Team-Orientation,  Adventure  Seeking,  Situational  Awareness). 

Previous  research  has  shown  that  the  TAPAS  is  a  valid  measure  for  predicting  a  broad  range 
of  performance  criteria  in  the  U.S.  Army  including  Army  Physical  Fitness  Test  (APFT)  scores, 
disciplinary  incidents,  and  attrition  (Knapp  &  Heffner,  2012).  Additional  research  demonstrated  the 
utility  of  the  TAPAS  for  predicting  perfonnance  within  specific  MOS  (Nye,  Drasgow,  Chernyshenko, 
Stark,  Kubisiak,  White,  &  Jose,  2012)  and  for  identifying  and  selecting  high-potential  Soldiers  for 
recruiting  duty  assignments  (Horgen,  Nye,  White,  LaPort,  Hoffman,  Drasgow  et  ah,  2013).  Given  its 
validity  in  past  research,  the  TAPAS  may  be  useful  for  identifying  Soldiers  who  will  be  selected  for 
Anny  Special  Operations  Forces  (ARSOF)  training.  Therefore,  the  goal  of  the  present  research  was  to 
explore  the  potential  utility  of  the  TAPAS  for  predicting  outcomes  in  an  ARSOF  assessment  and 
selection  course. 

Method: 

The  data  for  this  research  included  TAPAS  scores  and  ARSOF  selection  outcomes  for  1,216 
Soldiers  attending  an  assessment  and  selection  course.  The  outcome  reflected  whether  Soldiers  were 
selected  for  ARSOF  training  following  the  course.  Data  were  collected  from  February  to  June  2012. 
All  respondents  completed  the  TAPAS  immediately  prior  to  beginning  the  ARSOF  course. 

The  goal  of  this  research  was  to  identify  Soldiers  who  were  selected  for  ARSOF  training  after 
completing  the  assessment  and  selection  course.  We  used  correlation  and  regression  analyses  to 
examine  the  predictive  validity  of  individual  TAPAS  scales  for  ARSOF  selection.  We  also  developed 
a  composite  of  TAPAS  scales  for  predicting  selection,  which  could  be  useful  for  identifying  high- 
potential  Soldiers  who  are  likely  to  perform  well  in  an  ARSOF  course.  Similar  composites  are  being 
developed  for  the  selection  and  classification  of  Soldiers  in  the  U.S.  Army  General  Purpose  Forces 
(GPF;  Nye,  Drasgow,  Chernyshenko  et  al.,  2012).  However,  given  the  nature  of  ARSOF,  some  of  the 
TAPAS  scales  that  predict  selection  in  that  group  are  likely  to  differ  from  those  that  predict 
performance  in  the  broader  group  of  Army  GPF  applicants. 

Findings: 
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The  results  of  this  research  demonstrated  that  the  TAPAS  scale  scores  were  useful  predictors 
of  ARSOF  selection.  Therefore,  we  created  a  composite  of  TAPAS  scales  for  predicting  this 
outcome.  With  this  composite,  only  35%  of  individuals  that  scored  in  the  lowest  quintile  (i.e., 
individuals  with  composite  scores  in  the  lowest  20%)  were  selected  to  continue  in  the  ARSOF 
training  program.  By  contrast,  61%  of  individuals  scoring  in  the  highest  quintile  on  the  TAPAS 
composite  were  selected.  These  results  suggest  that  the  TAPAS  may  have  practical  importance  when 
used  to  identify  high  potential  ARSOF  candidates. 

Utilization  and  Dissemination  of  Findings: 

The  results  presented  here  provide  preliminary  evidence  for  the  validity  of  the  TAPAS  to 
predict  performance  outcomes  in  an  ARSOF  assessment  and  selection  course.  However,  more 
research  is  needed  to  support  the  utility  of  the  TAPAS  for  this  purpose.  Collecting  additional  data 
from  ARSOF  candidates  would  provide  larger  participant  samples  that  could  be  used  to  cross-validate 
the  TAPAS  composite  developed  for  this  research  and  explore  differences  across  groups  (e.g.,  MOS 
1  IB,  18X)  entering  ARSOF.  Additional  research  is  needed  to  explore  the  validity  of  the  TAPAS  for 
predicting  training  performance  subsequent  to  ARSOF  assessment  and  selection. 
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ASSESSING  THE  TAILORED  ADAPTIVE  PERSONALITY  ASSESSMENT  SYSTEM 
FOR  ARMY  SPECIAL  OPERATIONS  FORCES  PERSONNEL 


Introduction 

Interest  in  personality  as  a  predictor  of  performance  has  increased  considerably  over  the 
past  two  decades.  Much  of  this  interest  was  galvanized  by  empirical  evidence  showing  that 
personality  constructs,  such  as  conscientiousness,  predict  perfonnance  across  a  diverse  array  of 
civilian  and  military  occupations  (e.g.,  Barrick  &  Mount,  1991;  Campbell  &  Knapp,  2001)  and 
provide  incremental  validity  beyond  general  cognitive  ability  (Schmidt  &  Hunter,  1998). 

Despite  growing  interest  and  positive  empirical  support  for  their  validity,  personality 
measures  have  several  limitations  when  used  to  make  important  personnel  decisions.  A  major 
concern  is  applicant  faking  in  high-stakes  settings.  Past  research  has  shown  that  test  takers  can 
easily  identify  the  correct  or  socially  desirable  responses  on  single  statement  personality 
measures  and  increase  or  decrease  their  scores  when  sufficiently  motivated  (White,  Young,  & 
Rumsey,  2001).  As  a  result,  faking  is  a  potential  threat  to  the  validity  of  the  measure  and  may 
affect  its  utility  in  operational  selection  settings  (White,  Young,  Hunter,  &  Rumsey,  2008). 

To  help  address  issues  with  faking,  the  Tailored  Adaptive  Personality  Assessment  System 
(TAPAS)  was  developed  under  the  Army’s  Small  Business  Innovation  Research  (SBIR)  grant 
program.  It  takes  advantage  of  modern  psychometric  methods  and  computing  technology  to  offer 
a  new  generation  of  personality  measures  that  (a)  are  fake-resistant,  (b)  utilize  computer  adaptive 
technology  to  measure  across  a  broad  range  of  trait  continua,  and  (c)  are  easily  customized  to 
meet  the  assessment  needs  of  diverse  occupations  and  military  occupational  specialties  (MOS). 
The  TAPAS  can  measure  up  to  26  personality  dimensions  or  facets.  Of  these,  21  cover  the 
behavioral  patterns  associated  with  the  well-known  Big  Five  personality  framework  (Goldberg, 
1993).  The  remaining  five  dimensions  cover  military-specific  personality  traits  (Physical 
Conditioning,  Courage,  Team-Orientation,  Adventure  Seeking,  Situational  Awareness). 

TAPAS  tests  utilize  a  multidimensional  pairwise  preference  (MDPP)  format  that  is 
designed  to  be  resistant  to  faking  in  a  way  that  is  similar  to  the  Anny’s  Assessment  of  Individual 
Motivation  (AIM;  White  &  Young,  1998)  inventory.  Specifically,  items  are  presented  in  pairs 
and  respondents  must  choose  the  statement  in  each  pair  that  is  “more  like  me.”  In  the  past,  such  a 
response  fonnat  produced  only  ipsative  scores  (i.e.,  scores  that  sum  to  the  same  constant  for  each 
respondent),  which  are  largely  unsuitable  for  personnel  selection.  However,  the  MDPP  scoring 
system  used  for  the  TAPAS  has  overcome  this  major  limitation  and  is  capable  of  recovering 
nonnative  scores  regardless  of  how  many  dimensions  are  assessed  (Stark  &  Chernyshenko, 

2007;  Stark,  Chernyshenko,  Drasgow,  &  White  2012).  An  advantage  of  this  fonnat  is  that  it  is 
difficult  for  test-takers  to  fake  a  desirable  response.  Items  in  each  pair  are  matched  based  on 
social  desirability  and  extremity  on  the  dimensions  that  they  assess,  which  further  reduces  the 
likelihood  that  respondents  will  be  able  to  identify  a  conect  response  and  artificially  inflate  their 
scores.  Due  to  this  measurement  approach,  the  TAPAS  is  expected  to  demonstrate  validity  even 
in  high-stakes  settings  where  applicants  may  be  motivated  to  respond  dishonestly. 
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Validity  of  the  TAPAS 

In  2006,  the  US  Anny  Research  Institute  (ARI)  initiated  a  longitudinal  research  project  to 
examine  the  validity  of  non-cognitive  measures  for  predicting  Anny  outcomes.  The  goal  of  the 
Validating  Future  Force  Performance  Measures  (Anny  Class)  research  program  was  to  explore 
the  use  of  several  experimental  measures  for  selection  and  MOS  classification.  Results  showed 
that  the  TAPAS  provided  significant  incremental  validity  over  the  ASVAB  for  predicting 
attrition,  end  of  training  criteria,  and  in-unit  performance  (Knapp  &  Heffner,  2009;  Knapp, 
Owens  &  Allen,  2011).  In  addition,  this  research  also  showed  that  the  TAPAS  provided  non¬ 
trivial  gains  in  classification  efficiency  over  the  ASVAB  alone. 

Additional  predictive  validity  evidence  for  the  TAPAS  was  collected  during  the  U.S. 
Anny’s  Expanded  Enlistment  Eligibility  Metrics  (EEEM)  research  project  from  2007-2009 
(Knapp  &  Heffner,  2010).  The  EEEM  effort  was  conducted  in  conjunction  with  ARI’s 
longitudinal  validation.  Again,  TAPAS  dimensions  showed  incremental  validity  over  the  Armed 
Forces  Qualification  Test  (AFQT)  for  predicting  several  perfonnance  criteria.  For  example, 
when  TAPAS  trait  scores  were  added  into  a  regression  analysis  based  on  a  sample  of  several 
hundred  Soldiers,  the  multiple  correlation  increased  by  .26  for  the  prediction  of  physical  fitness, 
by  .16  for  the  prediction  of  disciplinary  incidents,  and  by  .20  for  the  prediction  of  6-month 
attrition  (Allen,  Cheng,  Putka,  Hunter,  &  White,  2010).  None  of  these  criteria  were  predicted 
well  by  AFQT  alone  (predictive  validity  estimates  were  consistently  below  .10). 

Based  on  the  results  for  the  Anny  Class  and  EEEM  research  projects,  the  U.S.  Anny 
approved  the  initial  operational  testing  and  evaluation  (IOT&E)  of  the  TAPAS  for  use  with 
Anny  applicants  at  Military  Entrance  Processing  Stations  (MEPS).  Since  this  project  began  in 
May  of  2009,  the  TAPAS  has  been  administered  to  approximately  420,000  Anny,  1 15,000  Air 
Force,  and  70,000  Navy  applicants.  With  these  data,  a  clearer  picture  of  the  validity  of  the 
TAPAS  in  operational  settings  has  emerged.  For  example,  this  research  has  shown  that  the 
TAPAS  has  validity  for  predicting  a  broad  range  of  performance  criteria  including  Anny 
Physical  Fitness  Test  (APFT)  scores,  disciplinary  incidents,  and  attrition  from  the  U.S.  Army 
(Knapp  &  Heffner,  2012).  Additional  research  demonstrated  the  utility  of  the  TAPAS  for 
predicting  performance  within  specific  MOS  (Nye,  Drasgow,  Chernyshenko,  Stark,  Kubisiak, 
White,  &  Jose,  2012)  and  for  identifying  and  selecting  high  potential  Soldiers  for  recruiting  duty 
assignments  (Horgen,  Nye,  White,  LaPort,  Hoffman,  Drasgow  et  ah,  2013).  Therefore,  a 
growing  body  of  evidence  suggests  that  the  TAPAS  may  be  useful  both  for  Soldier  selection  and 
classification  into  specific  MOS. 

Purpose  of  the  Current  Research 

Given  its  validity  in  past  research,  the  TAPAS  may  also  be  useful  for  identifying 
individuals  who  have  high  potential  to  become  ARSOF  personnel.  As  such,  the  goal  of  the 
present  research  was  to  explore  the  use  of  the  TAPAS  for  predicting  perfonnance  in  an  ARSOF 
assessment  and  selection  course.  Specifically,  we  examined  whether  the  TAPAS  scales  could  be 
used  to  form  a  composite  for  predicting  ARSOF  selection. 
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METHOD 


Sample 

The  data  for  this  research  were  collected  from  1,216  candidates  participating  in  ARSOF 
assessment  and  selection  courses  from  February  to  June  2012.  All  candidates  completed  the 
TAPAS  immediately  prior  to  beginning  the  course.  The  two  largest  MOS  of  Soldiers  in  the 
sample  were  Infantry  1  IB  (n  =  269)  and  Special  Forces  (Enlistment  Option)  18X  (n  =  219). 
Approximately  75%  of  the  sample  was  ranked  E3-E5,  and  1 1%  were  ranked  02-03.  Fifty-six 
percent  had  been  in  the  Service  for  less  than  3  years. 

Measures 

Predictor  Measure:  Tailored  Adaptive  Personality  Assessment  System  (TAPAS).  A  120- 
item  static  version  of  the  TAPAS  specifically  designed  for  ARSOF  personnel  was  administered 
to  the  candidates.  Table  1  lists  the  15  personality  dimensions  assessed  in  this  version  of  the 
TAPAS.  The  total  testing  time  for  these  dimensions  was  30  minutes.  Individuals  who  did  not 
complete  at  least  101  of  the  120  items  were  excluded  from  the  analyses.  Table  2  shows  the  inter¬ 
correlations  among  the  TAPAS  dimensions. 

Outcome  Measure:  ARSOF  Course  Selection.  The  criterion  for  this  research  was  the 
ARSOF  course  selection  outcome  for  each  candidate.  Specifically,  this  research  focused  on 
whether  Soldiers  were  selected  for  ARSOF  training  following  the  assessment  and  selection 
course.  This  selection  outcome  (i.e.,  selected  versus  not  selected)  and  a  description  of  the  reason 
for  a  negative  outcome  (e.g.,  voluntary  withdrawal)  for  each  individual  were  obtained  from 
administrative  records  for  the  course. 


Overview  of  Analyses 

Using  outcome  infonnation  from  the  course,  a  dichotomous  variable  was  created  by 
coding  selection  following  ARSOF  course  completion  as  1  and  voluntary  or  involuntary 
withdrawals  from  the  course  as  0.  Using  this  coding  scheme,  48%  of  the  sample  (n  =  585)  were 
coded  1  (selected).  The  total  sample  size  for  analyses  with  this  variable  was  n  =  1,216. 

With  this  criterion,  we  used  correlation  and  regression  analyses  to  examine  the  predictive 
validity  of  the  TAPAS  for  ARSOF  personnel.  Because  the  criterion  variable  was  dichotomous, 
we  used  logistic  regression  to  identify  the  TAPAS  scales  that  were  significant  predictors  of 
ARSOF  course  selection  and  to  develop  a  composite  of  TAPAS  scales  for  predicting  this 
criterion.  The  composite  may  be  useful  for  identifying  high  potential  ARSOF  candidates  that  are 
likely  to  perform  well  in  the  course.  Similar  composites  are  being  developed  for  the  selection  and 
classification  of  Army  GPF  Soldiers  (Nye,  Drasgow,  Chernyshenko  et  ah,  2012).  However, 
given  the  nature  of  ARSOF,  the  TAPAS  scales  that  predict  performance  in  this  group  are  likely 
to  differ  from  the  broader  group  of  Anny  GPF  applicants. 
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Table  1 

TAPAS  Dimensions  Assessed 


“Big 

Five” 

TAPAS  Facet 

Broad 

Name 

Brief  Description 

Factor 

Dominance 

High  scoring  individuals  are  domineering,  “take  charge”  and 

Ci 

o 

are  often  referred  to  by  their  peers  as  "natural  leaders." 

*C/5 

Ih 

Attention 

High  scoring  individuals  tend  to  engage  in  behaviors  that 

<D 

> 

Seeking 

attract  social  attention;  they  are  loud,  loquacious,  entertaining, 

H 

4— » 

X 

and  even  boastful. 

w 

Achievement 

High  scoring  individuals  are  seen  as  hard  working,  ambitious, 

C/5 

C/5 

confident,  and  resourceful. 

<1) 

£ 

Responsibility 

High  scoring  individuals  are  dependable,  reliable  and  make 
every  effort  to  keep  their  promises. 

.O 
%— » 
a 

Non- 

High  scoring  individuals  tend  to  comply  with  rules,  customs, 

o 

C/5 

Delinquency 

nonns,  and  expectations,  and  they  tend  not  to  challenge 
authority. 

c 

o 

o 

High  scoring  individuals  are  worry  free,  and  handle  stress 

Adjustment 

well;  low  scoring  individuals  are  generally  high  strung,  self- 

conscious  and  apprehensive. 

4-J 

Even  Tempered 

High  scoring  individuals  tend  to  be  calm  and  stable.  They 
don’t  often  exhibit  anger,  hostility,  or  aggression. 

CO 

13 

a 

.o 

*4-» 

Optimism 

High  scoring  individuals  have  a  positive  outlook  on  life  and 

o 

a 

tend  to  experience  joy  and  a  sense  of  well-being. 

w 

Intellectual 

Efficiency 

High  scoring  individuals  are  able  to  process  information 
quickly  and  would  be  described  by  others  as  knowledgeable, 
astute,  and  intellectual. 

2  CD 

A*  O 

<Z5  S 
<D  .2h 

High  scoring  individuals  are  interested  in  other  cultures  and 

Tolerance 

opinions  that  may  differ  from  their  own.  They  are  willing  to 
adapt  to  novel  environments  and  situations. 

Q .  X 

O  w 

Physical 

Conditioning 

High  scoring  individuals  tend  to  engage  in  activities  to 
maintain  their  physical  fitness  and  are  more  likely  to 
participate  in  vigorous  sports  or  exercise. 

C/5 

Adventure 

High  scoring  individuals  enjoy  participating  in  extreme  sports 

o 

ctf 

Seeking 

and  outdoor  activities. 

P-H 

o 

Courage 

High  scoring  individuals  stand  up  to  challenges  and  are  not 

o 

<D 

afraid  to  face  dangerous  situations. 

Oh 

CO 

Situational 

High  scoring  individuals  pay  attention  to  their  surroundings 

CO 
< 
p H 

Awareness 

and  rarely  get  lost  or  surprised. 

< 

H 

Team 

High  scoring  individuals  prefer  working  in  teams  and  help 

Orientation 

people  work  together  better. 
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Table  2 


Correlations  Between  the  TAPAS  Scales  in  the  Sample  ofARSOF  Candidates 


TAPAS  Scales 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13  14  15 

1 .  Achievement 

~ 

2.  Adjustment 

.09 

- 

3.  Adventure  Seeking 

.11 

.17 

- 

4.  Attention  Seeking 

.03 

-.02 

.09 

- 

5.  Courage 

.23 

.19 

.29 

.06 

- 

6.  Dominance 

.19 

.12 

-.02 

.18 

.14 

- 

7.  Even  Tempered 

.10 

.16 

-.06 

-.10 

-.03 

-.09 

- 

8.  Intellectual 
Efficiency 

.18 

.17 

.08 

.06 

.14 

.20 

.11 

— 

9.  Non-Delinquency 

.12 

-.13 

-.19 

-.15 

-.06 

.02 

.23 

.02 

- 

10.  Optimism 

.13 

.26 

.05 

-.04 

.13 

.12 

.12 

.12 

.02 

- 

1 1 .  Physical 
Conditioning 

.22 

.05 

.14 

.07 

.11 

.12 

-.02 

.03 

-.03 

.13 

— 

12.  Responsibility 

.28 

.22 

.03 

-.10 

.14 

.13 

.18 

.08 

.20 

.15 

.09 

- 

13.  Situational 
Awareness 

-.08 

.05 

.07 

-.17 

-.01 

-.06 

.05 

.12 

.01 

.06 

-.03 

.07 

-- 

14.  Team  Orientation 

.15 

.09 

-.10 

.08 

.08 

.16 

.19 

.00 

.12 

.10 

-.03 

.22 

.00 

15.  Tolerance 

.06 

.07 

.11 

.03 

-.02 

-.03 

.18 

.12 

.00 

.07 

.00 

.07 

.03  .14 

Note:  Bold  values  are  significant  at  the  .05  level.  The  sample  size  for  these  correlations  was  1,216. 
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TAPAS  Predictive  Validity  for  ARSOF 


The  descriptive  statistics  for  each  of  the  TAPAS  scales  are  provided  in  Table  3.  The 
means  and  standard  deviations  for  the  scales  are  provided  for  both  the  ARSOF  candidates  who 
were  assessed  for  this  research  and  for  the  MEPS  sample  of  Army  applicants  that  has  been 
collected  as  part  of  the  TAPAS  IOT&E  since  May  2009.  The  means  shown  in  Table  3  are  the 
raw  scores  in  each  of  these  samples.  These  scores  represent  the  mean  ability  estimates  (i.e.,  theta 
estimates  in  Item  Response  Theory  (IRT)  tenninology)  based  on  the  MDPP  scoring  algorithm 
used  for  the  TAPAS.  Although  these  are  raw  scores,  the  statements  and  parameters  are  consistent 
across  the  two  samples.  Thus,  to  the  extent  that  all  of  our  IRT  assumptions  are  satisfied, 
providing  both  sets  of  descriptive  statistics  illustrates  score  differences  between  ARSOF 
candidates  and  the  pool  of  Anny  GPF  applicants  on  each  of  the  TAPAS  scales. 

In  general,  differences  between  these  groups  were  as  expected.  For  example,  ARSOF 
candidates  scored  higher  on  Physical  Conditioning,  Achievement,  Tolerance,  and  Courage.  In 
contrast,  ARSOF  candidates  scored  lower  on  Attention  Seeking  and  Non-Delinquency  compared 
to  the  MEPS  sample.  These  comparisons  provide  an  initial  picture  of  the  TAPAS  personality 
profile  of  a  typical  ARSOF  candidate. 


Table  3 

Descriptive  Statistics  for  the  TAPAS  Dimensions 


TAPAS  Dimensions 

ARSOF  Candidates” 

MEPS  Sampleb 

Mean 

SD 

Mean 

SD 

Achievement 

.42 

.53 

.18 

.48 

Adjustment 

.32 

.53 

.02 

.53 

Adventure  Seeking 

-.23 

.66 

-.25 

.59 

Attention  Seeking 

-.52 

.58 

-.24 

.55 

Courage 

.67 

.73 

.12 

.54 

Dominance 

.29 

.58 

.11 

.58 

Even  Tempered 

.22 

.59 

.20 

.48 

Intellectual  Efficiency 

.06 

.59 

-.02 

.57 

Non-Delinquency 

-.48 

.57 

.11 

.48 

Optimism 

.41 

.43 

.18 

.46 

Physical  Conditioning 

.78 

.66 

.06 

.60 

Responsibility 

.58 

.55 

.34 

.46 

Situational  Awareness 

-.04 

.57 

.03 

.49 

Team  Orientation 

.18 

.56 

-.06 

.47 

Tolerance 

a  i  ^  i  z'  b  n  i  r 

.20 

.53 

-.19 

.56 

an  =  1,216.  Sample  sizes  range  from  30,054  to  256,375.  Not  all  TAPAS  dimensions  have  been 
administered  since  2009,  so  the  sample  sizes  vary  for  each  of  the  scales. 
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Table  4  provides  mean  TAPAS  scale  scores  for  each  of  the  ARSOF  course  outcomes 
represented  in  the  data  set.  Several  differences  are  worth  noting.  First,  individuals  who 
voluntarily  withdrew  from  the  course  or  left  due  to  poor  perfonnance  on  the  physical  tests  scored 
lower  on  the  Physical  Conditioning  scale  than  candidates  who  were  selected  (means  of  .48  and 
.68  compared  to  .86  in  the  selected  group).  Although  those  differences  are  not  surprising  for  the 
group  that  failed  the  physical  testing,  the  results  seem  to  suggest  that  a  number  of  people  are 
withdrawing  voluntarily  because  they  are  physically  unprepared  for  the  course.  In  addition, 
individuals  who  were  not  selected  due  to  non-specific  reasons  scored  lower  on  the  Adjustment 
(M  =  .04)  and  Responsibility  (M  =  .36)  TAPAS  dimensions  compared  to  the  selected  candidates 
(means  of  .35  and  .64,  respectively).  In  other  words,  these  individuals  may  not  have  been 
selected  because  they  appeared  less  reliable  (i.e.,  Responsibility)  and/or  were  unable  to  handle 
stress  (i.e.,  Adjustment)  as  well  as  others  in  the  course.  Finally,  ARSOF  candidates  who 
withdrew  from  the  course  for  medical  reasons  were  not  much  different  from  those  who  were 
selected.  This  suggests  that  those  individuals  withdrew  from  the  course  because  of  random 
events  rather  than  differences  in  their  personality  and  motivation. 

Overall,  these  comparisons  provide  some  initial  evidence  for  differences  between  the 
personality  profiles  in  each  of  these  groups.  Given  these  differences,  the  personality  dimensions 
measured  by  the  TAPAS  are  likely  to  predict  ARSOF  selection.  However,  given  the  small 
sample  sizes  for  many  of  these  groups,  subsequent  analyses  could  only  focus  on  variations 
between  the  selected  and  unselected  groups  rather  than  differentiating  among  the  various  reasons 
for  not  being  selected. 
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Table  4 


Mean  TAP  AS  Scale  Scores  by  ARSOF  Selection  Outcome 


Not  Selected 

Selected 

TAPAS  Dimensions 

IVW 

(N=321) 

MED 

(N=97) 

NS 

(N=20) 

PT 

(N=89) 

VW 

(N=104) 

(N=585) 

Achievement 

.39 

.39 

.40 

.42 

.39 

.45 

Adjustment 

.31 

.33 

.04 

.22 

.27 

.35 

Adventure  Seeking 

-.30 

-.30 

-.02 

-.27 

-.24 

-.17 

Attention  Seeking 

-.48 

-.55 

-.41 

-.64 

-.57 

-.52 

Courage 

.60 

.62 

.41 

.71 

.74 

.71 

Dominance 

.25 

.35 

.24 

.33 

.33 

.30 

Even  Tempered 

.24 

.17 

.27 

.16 

.11 

.25 

Intellectual  Efficiency 

.00 

.03 

.01 

.13 

.03 

.09 

Non-Delinquency 

-.49 

-.44 

-.56 

-.37 

-.51 

-.48 

Optimism 

.35 

.36 

.35 

.29 

.40 

.46 

Physical  Conditioning 

.74 

.82 

.88 

.48 

.68 

.86 

Responsibility 

.53 

.58 

.36 

.48 

.51 

.64 

Situational  Awareness 

-.11 

.05 

-.11 

.11 

-.08 

-.03 

Team  Orientation 

.20 

.14 

.41 

.24 

.19 

.16 

Tolerance 

.24 

.12 

.39 

.31 

.12 

.19 

Note.  IVW  =  Involuntary  withdrawal,  did  not  meet  course  standards;  MED  =  Medical  Reasons;  NS  =  Non-Specific;  PT  = 
Physical  Test;  VW  =  Voluntary  Withdrawal. 


Table  5  provides  the  correlations  between  the  15  TAPAS  dimensions  and  the  ARSOF 
selection  criterion  examined  here.  The  strongest  correlates  with  this  criterion  were  Optimism, 
Physical  Conditioning,  and  Responsibility.  Although  those  dimensions  had  the  strongest 
relationships,  the  magnitudes  of  the  correlations  were  still  relatively  weak.  This  may  have  been 
because  of  the  dichotomous  nature  of  the  criterion,  which  violates  the  assumptions  of  the 
Pearson  correlation  and  reduces  the  apparent  magnitude  of  the  effect.  Therefore,  the  size  of  these 
relationships  may  be  misleading  and  the  actual  effect  sizes  might  be  somewhat  larger.  As  such, 
we  next  used  logistic  regression,  which  was  designed  to  address  these  statistical  issues  and  is 
more  appropriate  for  analyzing  dichotomous  outcome  variables. 
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Table  5 


Correlations  between  the  TAPAS  Scales  and 


ARSOF  Selection 


TAPAS  Scales 

ARSOF 

Selection” 

Achievement 

.05 

Adjustment 

.06 

Adventure  Seeking 

.08 

Attention  Seeking 

.01 

Courage 

.05 

Dominance 

.01 

Even  Tempered 

.04 

Intellectual  Efficiency 

.05 

Non-Delinquency 

-.01 

Optimism 

.13 

Physical  Conditioning 

.11 

Responsibility 

.10 

Situational  Awareness 

.02 

Team  Orientation 

-.04 

Tolerance 

-.02 

Note.  Bold  values  are  significant  at  the  .05  level.  aN  =  1,216. 


Table  6  provides  the  regression  weights  for  the  TAPAS  scales  that  were  significant  predictors 
of  ARSOF  selection.  The  strongest  predictor  was  the  Optimism  scale,  which  identifies  individuals 
with  a  positive  outlook  on  life  and  a  general  sense  of  well-being.  Not  surprisingly,  the  Physical 
Conditioning  scale  was  also  a  significant  predictor  of  selection,  as  was  the  Responsibility  dimension. 
The  Nagelkerke  multiple  R  for  this  composite  was  .24,  suggesting  a  moderate  positive  relationship 
between  scores  on  this  composite  and  ARSOF  selection. 
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Table  6 


Significant  Regression  Weights  for  the 

TAP  AS  Scales  in  the  ARSOF  Selection  Composite 


TAPAS  Scales 

ARSOF 

Selection” 

Constant 

Achievement 

Adjustment 

-.61 

Adventure  Seeking 

Attention  Seeking 

Courage 

Dominance 

Even  Tempered 

Intellectual  Efficiency 

Non-delinquency 

.17 

Optimism 

.52 

Physical  Conditioning 

.26 

Responsibility 

Situational  Awareness 

.34 

Team  Orientation 

Tolerance 

-.23 

Multiple  R 

.24 

a  Because  standardized  weights  are  not  available  in  logistic  regression,  the  regression  weights  reported  are  the  unstandardized 
coefficients. 


Figure  1  illustrates  the  practical  importance  of  these  relationships.  Using  the  weights 
shown  in  Table  6,  we  formed  a  TAPAS  composite  and  calculated  the  predicted  scores  on  this 
composite  for  each  candidate  in  the  sample.  Next,  we  sorted  candidates  into  quintiles  on  the 
basis  of  their  composite  scores.  Figure  1  displays  ARSOF  selection  rates  for  candidates  in  each  of 
these  quintiles.  On  the  X-axis  of  this  plot  are  the  quintiles,  formed  on  the  basis  of  the  TAPAS 
composite  scores.  The  Y-axis  for  this  graph  represents  the  percentage  of  individuals  in  each 
quintile  who  were  selected  following  the  ARSOF  course. 

As  expected,  higher  TAPAS  scores  (i.e.,  the  top  quintiles)  were  associated  with  higher 
percentages  of  selection.  As  shown  in  Figure  1,  only  35%  of  candidates  who  scored  in  the  lowest 
quintile  on  the  TAPAS  composite  were  selected.  By  contrast,  61%  of  individuals  in  the  highest 
quintile  were  selected.  These  results  suggest  that  the  correlations  illustrated  in  Tables  5  and  6 
may  have  practical  importance  when  used  to  identify  high  potential  ARSOF  candidates. 
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ARSOF  Selection 
(n=  1,216) 


TAPAS  Composite  Quintiles 


Figure  1.  TAPAS  composite  quintile  plot  for  ARSOF  selection. 


Conclusions  and  Future  Directions 

Previous  research  has  shown  that  the  TAPAS  may  be  useful  for  Soldier  selection  and  can 
provide  incremental  validity  over  the  AFQT  for  predicting  key  criteria  such  as  physical  fitness, 
attrition,  performance  ratings,  and  personal  discipline  (Allen  et  ah,  2010;  Knapp  &  Heffner, 

2009;  Knapp  &  Heffner,  2012).  Based  on  large  samples  from  a  number  of  different  MOS, 
research  has  also  shown  that  the  TAPAS  can  be  useful  for  predicting  performance  within  specific 
Anny  specialties  and,  therefore,  may  also  be  important  for  classifying  Soldiers  into  MOS  (Nye, 
Drasgow,  Chernyshenko  et  ah,  2012).  Consequently,  it  is  possible  that  the  TAPAS  could  be 
useful  for  identifying  individuals  for  selection  into  ARSOF. 

Using  a  sample  of  candidates  from  an  ARSOF  assessment  and  selection  course,  the 
results  presented  in  this  report  provide  preliminary  evidence  of  the  utility  of  the  TAPAS  for 
identifying  Soldiers  with  a  higher  potential  for  being  selected  for  ARSOF  training.  Selection 
rates  in  the  highest  scoring  quintile  on  the  TAPAS  composite  were  substantially  higher  than  the 
corresponding  selection  rates  in  the  lowest  quintile  (61%  vs.  35%).  Therefore,  despite  the  modest 
Pearson  correlations  shown  in  Table  5,  the  TAPAS  appears  to  have  practical  usefulness  for 
predicting  ARSOF  selection. 

As  a  follow-up  to  these  encouraging  initial  findings,  more  research  is  needed  to  provide 
additional  evidence  for  the  validity  of  the  TAPAS  for  ARSOF.  Collecting  additional  data  on 
ARSOF  course  candidates  would  provide  larger  samples  sizes  that  could  be  used  to  cross- 
validate  the  TAPAS  composite  shown  in  Table  6  and  explore  differences  across  groups  entering 
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ARSOF.  For  example,  larger  sample  sizes  could  provide  sufficient  data  for  examining  and 
predicting  the  perfonnance  of  individuals  entering  ARSOF  from  MOS  18X.  Soldiers  in  this 
MOS  are  specifically  recruited  for  the  ARSOF  course  at  the  MEPS  and  were  one  of  the  largest 
groups  represented  in  the  sample  examined  here  (n  =  219).  Although  a  number  of  Soldiers  in  this 
sample  were  from  this  MOS,  there  were  still  not  enough  to  analyze  this  group  separately.  In 
addition,  larger  sample  sizes  would  provide  the  data  necessary  for  exploring  predictors  of  the 
various  reasons  for  ARSOF  course  withdrawal.  In  the  current  research,  the  sample  sizes  were 
only  large  enough  to  explore  the  personality  predictors  of  ARSOF  selection,  but  were  not  large 
enough  to  predict  other  specific  reasons  for  withdrawal,  such  as  APFT  failure,  withdrawal  for 
non-specific  reasons,  or  voluntarily  withdrawing  from  the  course.  Collecting  additional  data  to 
obtain  larger  sample  sizes  would  allow  these  issues  to  be  explored. 

Additional  research  is  also  needed  to  explore  the  utility  of  the  TAP  AS  for  predicting 
other  ARSOF  criteria.  In  the  current  research,  the  focus  was  specifically  on  identifying 
predictors  of  ARSOF  selection.  However,  past  research  has  shown  that  the  TAPAS  can  predict  a 
broad  range  of  perfonnance  criteria  in  the  Anny  GPF.  For  example,  the  TAPAS  appears 
particularly  useful  for  predicting  performance  on  the  job,  physical  fitness,  attrition,  and 
disciplinary  incidents  (Horgen  et  ah,  2013;  Nye,  Drasgow,  Chernyshenko  et  ah,  2012;  Knapp  & 
Heffner,  2012).  Therefore,  it  is  possible  that  the  TAPAS  would  predict  these  criteria  and  others 
in  ARSOF  personnel. 
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